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In the process of teacher evaluation, much needs to 
be taken into account other than a teacher *s activities and behaviors 
insxde the classroom. -Also to be considered are the teacher's fixed 
goals for a particular class, his attitude toward his students, his 
peers* * attitudes toward him, and an instructor's professional 
•activities. Who should conduct the evaluation of teachers is 
something to be taken very seriously. Some possibilities are an 
independent evaluation agency, interested students,, faculty and 
administrators in a college, or perhaps a« comrtitcee. composed of 
junior and senior members of a department, who does it depends on 
what purpose the evaluation is. to serve. Information derived from an 
initf al evaluation should be used as feedback for the instructor in 
_ord0l: that he might understand what others view as his faults. Then, 
a fol'low-up evaluation should be conducted to answer, the following 
questions: (1) Did the instructor .make an attemptr to improve what he 
or she was doing? (2) Are the instructor's values wij^h^^gard to 



iity^ 



colleagues 



things like professional research, writing and c 
compatible with the institution's values? (3) Do 
the instructor as a valuable member of the facul 
students reported tHat what they learhed from th 
^and out, he:|,ped them in decisioris about what to- 
post-graduate study or on thp job? The answers to these questions 
should help to determine whether ^the faculty member should be 
promoted or given tenure. (HS) 
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Evaluating Teaching: 
Some Problems 



There is now awareness of stroil^ needs to implement 
methods conducive to iTie improvement of teaching 
apd providing objective data for evaluation purposes 
Facuhy and administrators can no longey say merely 
that the^'ecognize the problem an^l that thev want 
to do something about it Pressures from college ad 
ministrations, students. legislatures, tb^'joh market, 
and other sources are demanding' that action be 
taken Current pix)cedure? range from informal 
student initiated and run evaluations to those hav 
ing varying degrees of support from administrators 
and faculty The goals of 'these procedures vary fmm 
telling students what the good and bad courses are 
-to providing administrators with something more 
than hearsay inf\prination about who the effective 
teachers are \ 

Lost in discussions about how to gather the neces 
sa!t\'' data, and ho\^ reliable and valid student inputs 
can be. is an extremelv-'importan. !?<^i>; Faculty mem 
bers have hiirdly been overly enthusiastic towards 
evaluation systems An important reason for this is 
that evaluation is an emotional issue and. conse 
quently, defe^fsive behaviors are evoked i-i niembers 
of the facult^T Most college teachers would acknowl 
edge that teaching effectiveness needs to br improved, 
that objective methods must be establi.,!ud for elim 
mating the deadwood from their ranks and for mak 
ing promotion and tenure decisions But **ew are 
willing to admit that perhaps their own teaching 



needs to be improved, thdt they may b'j one of the 
instances of departmental deadwood, or that they 
have not earned a promotion In a nutshell, cvalua- 
tions are often seen as a threat to self.-esteein and to 
job security. People have a tendency .to resist such 
threats. , 

The resistance can take several forms, ranging from 
overt opposition by voting against a system to verb- 
ali\ xrilici^ing it. K E Eble in The Recognition and 
Evaluation of College Teaching (November, 197 ' has 
provided several familiar examples of the latter 
Some of *he criticisms he found associated with eval- 
uating teaching were considerations i) that it could 
lead tr unhealthy competition among faculty mem 
bcr«^. 2) that student mpuis would not be vahd since 
they could be misleading or inadequate. 3) that the 
teaching proces^could becbme rather stereotyped and 
4) that no one knows what constitutes efTC-ctive teach- 
ing The tendency has been to recogni//; the resistance 
and then move along with the development of '>ieth 
ods to do the evaluation. It has not been sufficiently 
appreciated that this resistance will make it difficult 
for an evaluation system to be accepted and etTec- 
tnely employed. A well designed s^'Stem could atten 
uate some of this resistance. Current proposals. 
ho\\e\ei\ are rather narrowly conceived cind made 
quate to gam wide faculty support. Rather than 
minimize the threat to self esteem and job security, 
they will more than likely only mcrease it. 

Xiiore are se\eral factors associated *with current 
metnKds and assumptions which contribute to this 
problJin In the following paragraphs. I will describe 
these factors, specify their implications for the eval- 
uation process and 9^?^est .some ways that th(» prob 



lems might be overcome. 



To evaluate teaching implies that one knows the^ 
relationship between teaching and learning. Unfor- 
tunately.Jt 'is not clear just what the relationship 
■ really is Even so. evaluation systems are established 
\ without considering this issue in depth. In looking 
over some of the questionnaire data from other col- 
leges, it would s(?em that the designers have implicitly 
answered the question A casual glance at any ques * 
tionnaire designed to evalwate a teacher reveals'imny 
familiar queries about the behavior of the teacher 
teacher explains clearly, is friendly Xc ward students, 
^^osceses self confidence There.are two problems with 
the approach implied by such items. First, the activity 
of studenfs in the teaching learning process is 
ignored Teacher interpersonal behaviors and meth 
ods are only effective to the point that students are 
willing hnd able to use them. What the student really 
^needs from the teacher, in order to learn, is not 
emphasized in this approach. With regard to learn- 
ing the content of a course, most of this takes place 
in the privacy of the student s study area. The use- 
fulness to the student of such things as the teacher's ^ 
sense of humor? ' self-confidence, greeting students 
outside of class and other similar 'targets of evaiua 
tion instruments is not clear/If content acquisition- 
is one of the^major goals of education, what relevc^n'ce 
do these items have to liow well a teacher accom- 
plishes that goal? 

A second, related problem with thys approach is 
that It assumes ideal sets of teacher internersonal 
behaviors^ and classroom methods If this^we're true, 
one would expect that some teacher interpersonal 
behaviors and classroom methods would be inore'er 
fective than others in this process Otherwise, why ask 
questions about how well teachers do thmgs'> Unfor 
tunately, the research literature offers little support 
for making^ that assumption. AVith regard to content 
acquisition, it is becoming clear that a wide variety of * 
teaching methods (lecture, lecture discussion, di.scus 
sion) lead to approximately the same amount of con 
tent acquisition, as R. Dubin and T C Taveggia argue 
in The Teaching Learning Paradox Similarly, there 
is no- clear evidence that a teacher s qualities such as 
V availability to meet with students, possessing a 
friendly manner, .showing .self confidence or a sense 
of humor are positively related to various amounts^of 
content acquisition 'While students may be more 
satisfied or interested in class when teachers exhibit 
such behaviors, the effect that has on their learning 
is not clear To date, research on the relationship 
between rating scale categories and content learning 



has fail^ed to show that there is any suBstantial 
relationship. 

One might argue, of course, thai althougl^there are . 
few differences^in content acquisition, different class- 
room methods and teacher interpersonal behaviors 
may affect the student's satisfaction with a coui^e or 
•the learning of non-content skills (eg., positive socie- 
tal vaUies. collaborative interpersonal skills, ability to 
use resources). Tliere are several issues to take with 
this thinking. Granted that distinguishablemiethods 
might lead to changes in non-content bel/aviors of 
students, it is not clear w hat methods or tether inter- 
personal behaviors work best. Furtherrtf^-e. rfot every 
teacher is inierested in establishing goals in addition 
to contend, learning for his or her classes. To evaluate 
all teachers on this basis would be an obviouS injustice 
to many. 

Judging, then, from these consideraMons, an eval- 
uation .system .should not make a priori judgments 
about ideal teacher interpersonal behaviors and class - 
room metli^ods. Teachers have known intuitively for a 
long time that there arc no such things. It is not sur- 
prising^ that thT?y resist instruments that imply that 
such behaviors exist. A better way to initiate Mie 
evaluation of teaching is to ask^ te-achers what then- 
goals are for a class Presumably, what tKey do in the 
classroom is related to their goals. One>^specL^f:?the ^ 
evaluation would be how well the classroop^^1?nvifon^ 
inent is related to the student s abilitv to obtain con- 
tent and/or non content goals No ideal set of teacher 
behaviors or goals are implied in this approach. Since 
different instructors have different goals, a variety 
of interpersonal behaviors and methods would be 
expected .The evaluation interest is in whether the 
instijctor was able to' accomplish stated goals and 
w hich of his or her activities need to be improved. 

To state as precisely as possible th'^ goals for a 
cou?-se. one* coufd begin, for example, with general 
goals of content acquisition and the developing of 
interpersonal collaborative skills in students For ex 
ample. "Students should be able to list the important 
dates and events a.s.sociated with a given period of 
history," Or, The student .should be able to write a- 
satisfactory term paper in collaboration with two 
other students Students wouid then be polled to 
see how well things like lectures, outside readings 
and small group meetings allowed these particular 
goals to be obtained The real test of the effectiveness 
of a teacher s behavior is how the things ho or she 
did were .seen as useful contributions to the student's 
e.xperience with the course. ? 



[ One advantage here is that instructors are free to 
specify the type x)f classroom environment they want 
to 'establish and be evaluated. v.;i(h regard to how 
well their methods allowed their goals to be met. If 
one goal was to show students that teachers are 
human beings, then an instructor might do this by 
meeting with students informally, or appearing 
friendly. However, no assumptions are made "across 
the boaVd" as to the desir;ability of any one behavior 
for every instructor. Faculty members should feel less 
threatened under Hiis approach s'in<^e they are not 
asked to conform to^o called ' ideal" behaviors. Fur- 
thermore, the use of student feedback could serve 
as a basis .for modifying goals and/or methods to^ 
improve the classroom environment. This process 
could only lead to employment of a wider variety of 
teacher interpersonal behaviors and methods. Any 
subsequent changes in classroom activities would be 
the resuft of an objective examination of the methods 
previously emplpyed. Surely this is Ijette^ than the ■ 
subjective approach most often used today. Finally, 
this approach forces the e valuator to consider^ each 
class situation as a unique entity. While this means 
more work for the evaluator. such a system should 
contribute less to faculty resistance. ' 

Classroom-related beliavjors are certainly only 
one measure of a teacher s effectiveness. One should 
consider the instructor's influence once 'the student 
leaves the classroom. Some areas that should be con- 
sidered are how the student perceives a given teacher 
as influencing a) student's major field of study, b) 
types of course electives. c) decision to do post- 
graduate study, d) decision about what job to take 
and e) how well the instructor pre|)ared the student 
to work or study in. a field ^bviousjy. ihe above are 
not the only things one could consider They are 
merely examples of some of the ways an instructor's 
influence might appear outside of class The impor- 
tant point to recognize is that effectiveness criteria 
should not be locked into classroom-related behaviors 
How a teacher is perceived by his peers is an equally 
important part of an evaluation system. (^leagues 
can provide insights related to wnat they feel an in- 
structor's academic nnd,personal strengths and weak 
nesses are. Since such opinion.s have implications for 
how a teacher relates to colleagues and students, 
these thoughts should be brought to the surface. Few 
ini»truct6rs know where they stand in relation to their 
colleagues and how their behaviors are judged by 
th(^m. For the instructor who is interested in improve 
mdnt this can be valuable information. 



Finally, an instructor's professional activities should 
jjgl counted iman evaluation. Factors like research. 
, professional writing, involvcjment fn professional or- 
ganizations and meetings and involvement in com- 
munitv affairs are important. It must^'be noted that 
these things should be compared with the values of 
the educationa' institution. Conflicts can occur when 
the instructor's values and those of the institution 
are at variance (e.g . on the importance of, research). 
One function ^n evaluation could serve is to show 
instiiuctors where thediscrepancies exist early in their 
careers. I suspect that some of the surprise at not 
being promoted would disappear i/f such discrepan- 
cies were made explicit. 
\ Ifshould be clear at this point that 1 regard class- 
room aclLvities as only one area that s|iould be qon- 
sidered in developing an evaluation system. Many 
recent attempts at e^afuation have not adequately 
incorpon-^ted this thinking." Consequently, and 
understandably, faculty members are cool toward 
evaluation processes that rely exclusively on 
classroom-related behaviors. 

, But the'most neglected problenii?s just how an eva\ 
]^ uation syst-^m ought to be run and what-methods ofV 
data .collection might *be used successfully. 1 have 
three major suggestions to make: First, question- 
naiies and personal interviews. 'though useful tech- 
niques for obtaining data, cannot be designed 
intuitively. Professional consultation should be . 
sought in the design and implementation of these 
methods if they are to bemused by someone not trained 
in how to develop them". To measure a teacher s abil- 
ities, we want the most reliable and valid procedures 
available. While an infohnal approach might appear 
to be less threatening-thati a more rigorous one. that 
is exactly the approach most likely to suffer from defi- 
ciencies in method A famtliar problem is the^ne in 
which faculty members recognize those deficiencies 
^ftd then, appropriately, reject the data. Anything 
that is worth measuring is worth measuring well. 

As a second point, questions about faculty behavior 
should be written carefully. A little- known phejipm^ 
enon is a student's tendency not rate the cichial 
behavior of the faculty member Insteild the rating is 
made ofi how much that behavior deviates from a 
reference point that the student employs. For ex- 
ample, the instructor may be considered good or poor 
with reference jLo how .s^me "ideal" t<?acher behaves 
or in terms of the "average ability of the student's 
other instructors." In other words, the rating tends to 
reflect the discrepancy between the student's refeN 



once point and his impression of the instructor^he is 
evaluating With traditional rating procedures, these 
reference points are not assessed directly. The extent 
to which low ratings (or high ones) reflect the same'' 
degree of discrepancy between tlie reference point 
and*the actual behavior depends upon the assump 
tions that all students use the same reference point 
and have the same level tSf^xpectations for. that ref- 

• ei-ence point. That is, no problem would occur if all 
students used the average ability of all Jheir instruc- 

. toi;^ fis a reference point and rated this ability as 
"good" on a given question The rating of the actual 
behavior for that category*(e g . organization of 'lec- 
tures) would represent the same discrepancy for all 

^ students Unfortunately, research just completed by 
this author shows that students use mor^ than one^ 
reference point and that the reference poin^ts differ by 
student and the types of questions asked\slnce the ref- 
erence-point value systems of students ate different, 
individuaj^valuations on a rating scale arb basically 
incomparable; t\iey cannot be legitimately c\)mbined. 
This consideration ^question^ the appropriateness of 
all traditional rating propedures that are so often 
employed in teacher evaluation questionnaires. 

There are At least two ways that this problem'might 
be minimized- One way is to assess the student'^ ref- 
erence pojnts with regard to the teacher's behavioral 

. categories under consideration Having this informa- 
tion would help to make reasonable interpretations 
of the behavior ratings possible. Another course is to 
look speCificully at how well the teachers behaviors 
and methods helped students meet the goals of the 
course Taking this approach, one is less interested 

• in rating a set of teacher behaviors in terms of 
"good.Vr^Por."' and so forth For example, evaluative 
questions touching on whether the teacher was 

r'*friendly" or whether he or she assigned a "large 
amount" of reading would not be asked in terni^ of 
"goq£l'\or "poftr " RrUher the emphasis v/ould be on 
seeking specific ways that the "friendly" behavior 
>^and reading assignments helped or hindered the stu- 
dent's learning The orientation of^he questions 
would be different since they would concentrate on 
the specific effects of teacher interpersonal behaviors 
and methods on the student's performance. A further 
payofT of this plan is that the type oP information col 
lepted is more useful to the teacher since iJL can be 
^ised to improve specific behaviors. A rating of ;*good" 
'on friendliness might be useful because students 
were not afrdid to ask for clarifications of content 
after class. ^ 



How long an evaluation should last and who should 
conduct it is the third major issue demanding atten- 
' tion. There is a tendency in the literature to assume 
that students or interested faculty can write a ques- 
tionnaire, administer it, publish the data and then 
regard the joh as complete. If my argument in this 
article is at all legitimate, it should be apparent that 
a quick and dirty job would yielS rather^oor data. 
To assess a teacher with regard to. just some of the 
considerations suggested here * -ill take time. I doubt 
that an adequate assessment of what positive and 
negative effects an, instructor.,is paving could l?e ac- 
complished in less than one yels^r. This assumes that 
on^s-intere^ted in obtaining information, giving the 
'instructor feedback, and then reassessing to see 
whether positive^ changes have occurred in the in- 
structor's behavior. This is par^icilarly important 
\Nhen promotion and tenureconsideYations are ti^d in 
with the evaluatfon effort. 

Who should conduct the evaluation is something 
that likewise must be taken seriously. Some possibili- 
ties\'ire an independent evaluation agency> interested 
students, faculty and administrators in a college, or 
perhaps a committee composed of junior and senior * 
members of a department. Who does it depends upon » 
what purpose the evaluation is to serve. Again, this is 
particularly important when promotion and tenure^ 
are involved. The important pomts ^re that a groxx^ 
ought to be made up of people whom faculty members 
can trust and that competent evaluation guidelines 
and goals be established. The written expression of 
guidelines and goals should be done in conjunction 
with*compe\ent professi9nal advice and with the use 
of inputs from as many relevant sodrces as possible. 
Before the evaluation is undertaken, the guidelines 
and goals should be communicated to the faculty 
members .who will be evaluated. ^ 

I hope that some of the conceptual, methodological 
and openUional suggeslions made-in this article will 
help to attenuate the resistance 'towards an evalua- 
tion of teaching effectiveness. Furthen^ioi-e, it is my 
belief that a.sking questionsabouthowsprartc teacher 
behaviors were or were not useful inputs to students 
fdr meeting the course goals should give the teacher' 
mformation forchangmg the classroom environment 
intelligently. Finally, 1 would suggest that the data 
collected be used initially for fieedback purposes. By 
this I mean that bcforp-evaluation data is used for 
promotion and tenure considerations, the instructor 
should he given the opportunity to improve. How much 
he improved is n^t the issue for promotion and tenure. 



Rather, those who make the decision should ask the 
following questions: ^ 

First, did the instructor make an attempt to improve- 
what he or she was doing? Professionals should be 
cor'^erned Vith improving what they do. Instructors 
wh. a^e not interested in improving their techniques 
are not worth having on a faculty, 

.Second, are the instructors values Vith regard to 
things like professional rese^^rch^ writing and com 
munity. service c6mpatible 'with the institution's 
values'? Feed' ack to the instructor would make this 
clear If the institution considers ^ny or all of the5e 
things infportant, then the instructor should be told 
^what is expected Ho\^ well the faculty person con 
forms to these values w"ould be st promotion and ten 
u re consideration, , 

Third,, do colleagues i^erceive the instructt^r as'a 
valuable memV>er of the faculty? Presumably, instruc 
tors would be given feedback consisting of how. col 
leagues perceive them, as, professionals. This could 
help them to work on relationships an'd to raodi/y 
behaviors'In ways that are less antagonir.ing to col 
leagues Interest hert) would not be so much with 
interp,ersonal habits as they would be with how^the 
teacher is i^erceived as sharing the administrative 
load (e,g,. advising students/serving on committees, 
participating in faculty meetings, etc J. 



Fourth, have students reported that what they 
learned from the course, m class and out, helped them 
in decisions about what to jnajor in, post-graduate 
^ludy or on the job? Teachers who are considered ef- 
fective should be those seen as contributing some- 
thing of use to the student beyo.id the course itself. 
If deficient in this area, a concerned instructor would 
try to change what he or she is doing. 
^ A broadly conceived evjiluation system shbuld give 
those who mak'e promotion and tenure decisions the 
appropriate information. How various inputs should 
be weighed is another issue. Assignmg differential 
weights to each category (or to any others that are 
developed) is really not useful and ,will needlessly 
raise value issues. Professionals should be concerned 
with improving. their professional behaviors. Based 
on changes in the inputs obtained from a broadly-* 
conceived evaluation enterprise and considered with 
respect to clearly expressed goals, it will become quite 
clear who the professionals are. The important con- 
siderations in who to promote and/orgive tenure *to 
are whether a faculty member is honestly concerned 
with jmprpvement And can be objectively seen as 
having taken steps in this direction. Only those con- 
cerned about improving and who try deserve the title 
of teacher. 

- Anthony F. Grasha 
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